
Petri nets in workload modeling where concurrent raid parallel activities ere common. Petri 



represent task events end activities of a human operator in a man-machine system. For 
example, Madni,Chu, Purcell and Brenner ( 1983) used MPNs to model the tasks underlying the 
identification ami reaction to a lube oil leak in a ship propulsion system, fladni and Lyman 
( 1 983) used a MPN to model the checkout end start-up procedure for a Cessna 1 82 light 
aircraft. White, MacKinnon and Lyman ( 1 98-4) formulated a MPN for POPCORN, a complex 




demonstrate the usefulness of MPNs in the formal representation of systems. It Is our general 
hypothesis that in addition to descriptive applications MPNs may be useful for workload 
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estimation and prediction. 

This paper reports the results of the first of a series of experiments designed to develop 
end test a MPN system of workload estimation end prediction. This first experiment is a 
screening test of MPN model general sensitivity to changes in workload. Positive results from 
this experiment will justify the more complicated analyses and techniques necessary for 
developing a workload prediction system. 

Our analytical work with MPNs has exposed three critical issues that ere relevant for 
workload applications of MPNs, viz. , task complexity, level of task representation detail , and 
activity and event classifications. 

MPNs differ according to task complexity such as a relatively linear task such as 
identifying an oil leek end taking appropriate action in comparison to a circular task with many 
goals and repetitions such as the POPCORN simulation. In POPCORN, An large number of trade 
offs between offensive and defensive strategies ere possible throughout the course of one 
experimental trial. The critical areas for workload estimation often involve circular type tasks 
such as the activities of a aircraft or automobile operator. The experimental task to be 
described below is complex and circular in nature, but is programmed so that the necessary 
information for MPN development can be obtained. 

Level of task representation refers to the level of detail of the task that is being modeled. 
For example, using Medni and Lyman's ( 1983) task, the start-up and checkout procedures for 
the Cessna plane can be simply modeled as follows: alter the plana, start the engine end then 
take off, ( a two activity and three transition MPN). Alternatively each muscle movement of the 
pilot in each activity leading to take off could be modeled (a very large MPN). The level of task 
representation issue is important because on the one hand a detailed map of the task is required 
to obtain adequate sensitivity to workload changes. On the other hand, there are limitations on 
the measurement techniques that can accurately partition task components for a MPN model with 
the necessary level of detail. For example, with the current level of technology it is not possible 
to know precisely when shifts of attention occur between task elements. The MPN derived from 
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the task we have devised represents a compromise on the level of detail issue, it is Intended to be 
a task designed to elicit meet of the information needed for analysis in MPN terms. Additional 
information can be obtained via control experiments designed to measure specific mental 
processes that cannot be measured with the experimental task alone. 

Activity end event classification schemes refer to the classification of events and activities 
in terms of general workload categories. If activities and events can be categorized in terms of 
workload then it is not necessary to estimate the workload contribution of each individual emit 
and activity. The classification analysis is an area of advanced work and will be conducted in the 
next stage of this research. 

Method 

Subjects: Eleven UCLA undergraduate volunteers served as subjects. Each subject 
participated in a two hour experimental session. 

Materials: The entire experimental procedure was conducted on a Televideo 803 computer 
with a mouse controller. 

Procedure: A dual task similar to Derrick and McClcy's ( 1 984) composed of e tracking 
task and a vowel insertion task was devised. The tracking task was a standard compensatory 
tracking task with a cursor moving along the horizontal axis driven by a random forcing 
function. The subject was instructed to try to keep the cursor near the center of the line with a 
mouse controller. Easy and hard levels of difficulty were introduced by changing the forcing 
function parameters. A vowel insertion task was incorporated into the tracking task by using 
the cursor itself as the stimulus letter. It was presented as a consonant that was replaced 
randomly at intervals of three to seven seconds. The subjects were instructed to mentally insert 
the letter “A" between the consonant that was currently displayed and the previous one. This 
consonant- vowel -consonant combination might or might not form an English word. The task of 
the subject was to indicate whether it was a word or not by means of switches located as part of 
the mouse controller. The cognitive load of the vowel insertion task was manipulated by 
increasing the number of vowels that the subject must sequentially insert. For example, with 
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three vowels to Insert (“A", "E", & T) the subject was required to make three lexical 
decisions and therefore three key press responses, to a comparative basis, one vowel 
represented a low cognitive load and three vowels represented a high cognitive load. 

The one versus three vowe Is, and hard versus easy tracking tasks were crossed to form 
four conditions. Thus each subject conducted two four-minute trials in all four conditions, viz. , 
high cognitive load — -low tracking load, high cognitive load — -high tracking load, low cognitive 
load- low tracking load and low cognitive load — -high tracking load. The order of the conditions 
was counterbalanced and each subject was given two minutes of practice in each condition. 

Subjects performed the task individually and with the CRT screen at eye level. They were 
instructed to keep the cursor at the renter of the horizontal bar using the mouse controller. 

They were told to press one switch on the mouse when the consonant- vowel -consonent (CVC) 
was an English word and press another switch on the mouse if the CYC was not a word. After each 
condition the subject ratal her/his level of workload on ten scales of workload level and task 
difficulty that are in use for the POPCORN task at NASA-Ames, with the exception that the 
skill- , rule- , and knowledge-based scale was replaced by an scale on eutomaticity. 

Two control conditions were conducted to obtain measurements for certain parameters of 
the MPN. The control conditions were used to estimate the length of time necessary for certain 
mental process which cannot be derived by the data available from the experimental conditions. 
The first experiment obtained a simple reaction time to the change of consonants that are used 
in the vowel insertion task. This task generated an estimate of the initial start-up and response 
activities involved in the vowel insertion task. The second control task combined the tracking 
task and a two choice reaction time. The cursor was displayed as the letter T‘ and was replaced 
by an “X* or and "0" every three to five seconds. Each *X“ or “0“ was displayed for one half 
second. The subject depressed one key if it was and "0“ end another key if it was an “X". This 
procedure provided an estimate of letter identification time and the decision processes involved 
in selecting the appropriate key to press. The subjects performed each control condition with 
both levels of tracking difficulty. The control conditions were randomly mixed with he 
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experimental conditions. 

Each subject generated mi individual difference bias rating for the bipolar rating scales. 
The procedure was the same one as used at NASA-Ames in which subjects reted which of two 
scales Is more important. Each possible comparison of the ten scales wss rated Because the 
subjective rating sales differ in importance end meaning for each subject, the individual bias 
information was considered important for accurate workload estimation. This information can 
be used to weight the ratings. However , only the unweighted rating scores were used in the 
analyses reported below. 

Modified Petri Net of the Dual Task: The MPN for the experimental task is displayed in 
Figure 1. F igure 1 a displa/s the net for the entire tssk. Figures lb, 1c and Id displa/ the 
subnets for tracking and vowel insertion. Table 1 presents the activities and events for each 
experimental task. 


Results and Discussion 

The preliminary analyses were conducted to verify that the experimental manipulations 
were effective in changing workload. A 2 ( high versus low cognitive load) by 2 ( hard versus 
easy tracking) analysis of variance was conduced on each of the ten ratings, the residual mean 
square error ( RMS) measure end the permit correct on the lexical decision measure. 

The anova on the RMS error of the tracking showed a significant main effect for the 
tracking condition (F-95.18, p<.00 1 ) and vowel insertion condition (F- 8. 16, p<,05), with the 
hard levels of difficulty having the greater RMS error. The anova on the Percent Correct of the 
vowel insertion showed a significant main effect for the vowel insertion condition ( F =27.40, 
p< 00 1 ). However, tins herd level of vowel insertion demonstrated the better performance. This 
can be explained by the fact that the second end third letters for the vowel insertion ( “E“ and 
"I") created much fewer english words compared to Inserting the letter “A*. Thus, the sub] arts 
me/ have been biased into responding NO for most of the second and third vowel insertions end 
this strategy paid off. A more appropriate comparison , then, would be to compare the percent 
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correct of the first vowel insertion of the hard level (the letter "A") end the percent correct of 
the easy level (the letter "A"). This analysis showed no main effects. 

Table 2 shows the F values of the anovas conducted on the unweighted workload rating 
rales. Two of the ten rales stowed a main effect for the tracking condition, while 8 of the ten 
stowed main effects for the vowel insertion condition. These results indicate that the 
experimental conditions did Indeed manipulate workload. 

Anovas were also conducted the output of the MPN simulations of the experimental trials. 
The data derived was the number of times each transition fired, the total amount of time each 
place was activated, and the number of times each place was activated. 

Because the activities represented by places 6, 7, 8, & 9 were not directly observable, the 
estimation of these activity times involved the inclusion of date obtained in the control 
conditions. These derivations were more complicated and were unavailable for the analyses 
reported below. 

Table 3 stows the F values for the anovas on the transitions and Table 4 stows the F values 
for the anovas on the pieces of the MPN simulation. Transitions 1 and 4 were not tested since 
they did not vary across conditions. The main point of these two tables is that the transitions and 
places that modeled the tracking components stowed main effects for the tracking condition, aid 
the ones that modeled the vowel insertion showed main effects fir the vowel insertion condition. 
This indicates that the MPN model appropriately represented the experimental task. 

However , a more important question is whether the MPN represented the workload 
Involved in the task. It is possible that other components of the task , which were not possible to 
model the the MPN, were more important contributors to the workload involved in the task. 
Thus, it was necessary to demonstrate a relationship between the MPN parameters end the 
subjective workload ratings. To to this, a canonical correlation was conducted between the MPN 
parameters end the workload ratings. The results of the canonical correlation showed that the 
first four eigenvalues were significant. This indicates that four undo' lying factors of the MPN 
parameters are highly related to four underlying factors of the workload ratings. 
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Summary and Future Directions 


The results of the canonical correlation indicated that MPN model of the experimental task 
represented the task components that influenced subjective workload. Thus, the goal of this 
experiment was achieved by this demonstration that the MPN model was sensitive to workload 
changes. 

The next stage of this research will involve generating a classification scheme that will 
group events and activities that we similar in their contribution to task workload. Workload 
values for each class of events and activities can then be derived. This will allow testing of MPN 
model simulations for their prediction capability of the workload of a task. 
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FOOTNOTES 


' This work was supported by NASA-Ames under grant *4-4-42550- 23331 
^The order of the first two authors is arbitrary. 
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Transitions 
T f -Start 

T 2 -Cursor leaues task boundaries 
Tj-Restart 

T^-Consonant Changes 

T^-Lexical decision process complete 

Tg-Letter identification complete 

T ? -LeKicial decision complete 

Tg-Response decision complete 

Tg-Response complete (continue 
with next uowel) 

T| Q-Cursor moues 

Tj I -Cursor passes mark 
T| 2 -Monitor & calculate complete 
Tjj-Cursor posses mark 
T|4~Moiie completed 


Places 

P I -Uowel insertion actiuity 
P 2 -Tracking actiuity 
Pj-UJait (2 seconds) 
P^-Monitor (cursor) 
Pj-Lexicol decision actiuity 
Pg-Letter identification 
P ? -LeHdol decision 
Pg-Response decision 
Pg-Response 

P I g-Monitor (tracking) end 
calculate moue 

P|t-Moue to compensate 
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WORKLOAD RATIN6S 
F URLUES 

TRRCKIN6 VOWEL INSERTION INTERACTION 


OVERRLL 




WORKLOAD 

3.19 

15.32** 

0.77 

TASK DIFF. 

3.51 

36.22*** 

0.39 

STRESS 

9.31* 

17.35** 

0.01 

FRUSTRATION 

4.97* 

30.93*** 

0.04 

PHYSICAL 

EFFORT 

2.29 

0.01 

0.49 

MENT/SEN 

EFFORT 

3.22 

23.14*** 

0.27 

FATIGUE 

0.50 

0.04 

4.41 

RUTOMRTICITY 

4.28 

13.27** 

0.69 

TIME PRESS 

1.06 

54.50*** 

1.11 

PEFORMRNCE 

3.69 

11.89** 

0.34 

*p <.05 

**p <.01 
***p<.001 
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TRANSITIONS 
F tJBLUES 



TRACKING 

OOIilEL INSERTION 

INTERACTION 

*2 

6.15* 

1.12 

16.98** 

*3 

6.15* 

1.12 

16.98** 

% 

1.91 

0.60 

0.45 

% 

1.91 

9.60 

0.45 

T 7 

2.18 

107.73*** 

4.21 

% 

2.18 

107.73*** 

4.21 

T 9 

2.18 

107.73*** 

4.21 

T 10 

6.18* 

2.62 

17.30** 

T 11 

9.22* 

0.05 

3.08 

T I2 

37.81*** 

0.31 

1.60 

T 13 

71.22*** 

0.08 

16.24** 

T 14 

37.63*** 

0.26 

1.57 


* p <.05 

**p <.01 
***p <.001 
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PLACES 
F VALUES 



TRACKING 

VOWEL INSERTION 

INTERACTION 

TOTAL TIME 

P 1 

5.54* 

2.17 

17.20** 

P 2 

5.54* 

2.17 

17.20** 

P 3 

5.54* 

2.17 

17.20** 

P 4 

0.27 

31.99*** 

8.42* 

P 5 

2.88 

26.80*** 

14.05** 

P 10 

43.34*** 

0.34 

0.20 

P 11 

26.93*** 

0.09 

0.10 

FREQUENCY 

P 1 

3.40 

1.40 

13.80** 

P 2 

3.40 

1.40 

13.80** 

P 3 

6.15* 

1.12 

16.98*** 

P 4 

2.41 

0.47 

0.51 

P 5 

1.91 

0.60 

1.52 

P 10 

36.65*** 

0.29 

1.50 

P 11 

31.38*** 

0.53 

1.20 


* p <.05 

**p <.01 
***p<.001 
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FIGURE 1A 
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